Bridging the gap between machine translation output and images in multimodal documents

نویسندگان

چکیده

The aim of this article is to report on recent findings concerning the use Google Translate outputs in multimodal contexts. Development and evaluation machine translation often focus verbal mode, but accounts by area exploration text-image relations documents translated automatically are rare. Thus, work seeks describe just what such how them, organized two parts: firstly, exploring problem through an interdisciplinary interface, involving Machine Translation Multimodality analyze some examples from Wikihow website; secondly, reporting investigation suitable tools methods properly annotate these issues within a long-term purpose assemble corpus. Finally, provides discussion findings, including limitations perspectives for future research.

برای دانلود باید عضویت طلایی داشته باشید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translation

Neural Machine Translation (NMT) is an end-to-end learning approach for automated translation, with the potential to overcome many of the weaknesses of conventional phrase-based translation systems. Unfortunately, NMT systems are known to be computationally expensive both in training and in translation inference – sometimes prohibitively so in the case of very large data sets and large models. ...

متن کامل

SHEF-Multimodal: Grounding Machine Translation on Images

This paper describes the University of Sheffield’s submission for the WMT16 Multimodal Machine Translation shared task, where we participated in Task 1 to develop German-to-English and Englishto-German statistical machine translation (SMT) systems in the domain of image descriptions. Our proposed systems are standard phrase-based SMT systems based on the Moses decoder, trained only on the provi...

متن کامل

Bridging the gap: Thai - Thai Sign Machine Translation

We propose a multi-phase approach, Thai-Thai Sign Machine Translation (TTSMT), to translate Thai text into Thai Sign language. Thai Sign language is the language of the deaf in Thailand. TTSMT begins the translation process by segmenting the input sentence since Thai is a non-word boundary language, converting the segmented sentence into simple sentence forms since most Thai Sign are expressed ...

متن کامل

Bridging the Inflection Morphology Gap for Arabic Statistical Machine Translation

Statistical machine translation (SMT) is based on the ability to effectively learn word and phrase relationships from parallel corpora, a process which is considerably more difficult when the extent of morphological expression differs significantly across the source and target languages. We present techniques that select appropriate word segmentations in the morphologically rich source language...

متن کامل

Bridging the gap between sign language machine translation and sign language animation using sequence classification

To date, the non-manual components of signed utterances have rarely been considered in automatic sign language translation. However, these components are capable of carrying important linguistic information. This paper presents work that bridges the gap between the output of a sign language translation system and the input of a sign language animation system by incorporating non-manual informat...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Cadernos de Tradução

سال: 2021

ISSN: ['2175-7968', '1414-526X']

DOI: https://doi.org/10.5007/2175-7968.2021.e75483